Gated DeltaNet

Alibaba's Qwen team released Qwen-AgentWorld-35B-A3B, a language world model that predicts environment states rather than actions, trained on over 10 million interaction trajectories across seven agen…

Researchers introduced Gated DeltaNet-2, a linear attention model that decouples the erase and write operations in recurrent state updates using separate channel-wise gates. The model outperforms Mamb…

Alibaba's Qwen3.6-27B dense model outperformed its own 397-billion-parameter MoE predecessor on SWE-bench Verified (77.2% vs. ~76.2%) while running on a single RTX 4090, challenging the prevailing MoE…